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Abstract 

We formulate the MFG limit for N interacting agents with a common noise as a 
single quasi-linear deterministic infinite-dimensional partial differential second order 
backward equation. We prove that any its (regular enough) solution provides an 
1/A-Nash-equilibrium profile for the initial A-player game. We use the method of 
stochastic characteristics to provide the link with the basic models of MFG with a 
major player. We develop two auxiliary theories of independent interest: sensitivity 
and regularity analysis for the McKean-Vlasov SPDEs and the 1/A-convergence 
rate for the propagation of chaos property of interacting diffusions. 
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1 Introduction 

We shall denote by the space of signed Borel measures on R” of finite total 

variation, by A1(R"') its cone of positive measures, by A1 a(R"') their subsets 

of total variation norm not exceeding A, by P(R"') the set of probability measures. We 
shall use the standard notation (0,/i) = / (f){x)^{dx) for the pairing of functions and 
measures. By E we denote the expectation. 

Let us consider N agents, whose positions are governed by the system of SDEs 

dXl = b{t, XI /if, ul) dt + aind{Xl)dBl + a,om{Xi)dWt, (1) 

where all XI belong to R, lW,i?f , Rf are independent one-dimensional standard 
Brownian motions, Wt, referred to as the common noise, and all Bf, referred to as the 
idiosyncratic or individual noises, the subscripts ’com’ and ’ind’ referred to the objects 
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related to the common or to the individual noises. The parameters u\ ^ U <Z are 
controls available to the players, trying to minimize their payoffs 


VilT|W = E 


J{s,Xl,i,':,u',)ds + VT{X'j.,4) 


Jt 


( 2 ) 


depending on the action of other players, with the given functions J and Vr- The coeffi¬ 
cient h{t,x,n,u) is a function of t G R, x G R, u G 17 and a measure /i G and 

/if in (d]) is 



2=1 


In general, the function b needs to be defined only for /i from the set of probability 
measures V{R^). However, to use smoothness with respect to /i it is convenient (though 
not necessary) to have this function defined on a larger space. In the usual examples, b 
depend on /i via a finite set of moments of type 


F^/i) 


Fj{xi, ■ ■ ■ ,Xk)fi{dxi) ■ • -//(dxfc). 


(3) 


with some bounded measurable symmetric functions Fj. 

For simplicity, we shall assume b to be linear in u, that is, 

b{t, X, jj,, u) = blit, X, /i) b 2 {t, X, /i)M, (4) 

though other weaker assumptions are possible. 

Remark 1.1) For this paper we shall stick to a smooth dependence ofb on /i. However, 
more singular dependencies are also of interest, for instance, the dependence on /r via 
its quantile, see IWf . This case will be discussed in our subsequent publication based on 
the theory of SDEs with coefficients depending on quantiles developed in 2) In an 

attempt to present our main result in the most clear way, we make several simplifying 
assumptions, primarily that all objects are one dimensional and that aind does not depend 
on fi and u, which can he relaxed causing the increase of technicalities. 3) We consider 
the simplest common noise Wt- It would be natural to extend the theory to the space-time 
white noise W{dxdt) or even to a more general noise expressed in terms of functional 
semimartingales F(x, f) analyzed in ISTf . 

It is known (see e. g. [32]) that, for fixed common functions u\{Xl) = Ut(XJ:), and 
under appropriate regularity assumptions on b, Cind, CTcom the system ([1]) is well-posed and 
the corresponding empirical measures /if converge, as iV —)■ cxo, to the unique solution fit 
of the nonlinear SPDE of the McKean-Vlasov type 

d{(j), fit) = {L[t, fit, Utlf), fit) dt -F (crcom(-) fit) dWt, (5) 

which is written here in the weak form meaning that it should hold for all 0 G C'^(R), 
and where V is the derivative with respect to the space variable x and 

1 (j) dcj) 

L[t,fit,ut](f){x) = -(afrf + a^f J(x)—-l-6(t,x,/it,Mt(x)) —. (6) 
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Let us mention directly that in our approach it is more convenient to work with the 
Stratonovich differentials. Namely, by the usual rule V o dX = YdX + ^dYdX, equation 
(j5j) rewrites in the Stratonovich form as 

d{(j),fit) = {Lst[t, fit) dt + d-t) o dWt, (7) 


with 


r r n , / N 1 2 / \ 

Lst[t,fiuUt](j){x) = lfind{x)-^ 


+ [b{t,x,^it,Ut{x)) - -acom 


1 

2^ 




(^)] 


90 

dx 


( 8 ) 


With some abuse of notation, we shall often identify measures with their densities 
(whenever they exist) with respect to Lebesgue measures, thus writing the strong form of 
equation (jS]) as 

dfxt = L'[t,fit,uMtdt-X{acom{-)fJ^t)dWt, (9) 


with 


\pi d'l '^t\ 


1 92 

2 9a;2 




A 

dx 


[b{t,x,id,ut)ij]. 


( 10 ) 


This identification does not cause ambiguity, because under non-degeneracy of -|- cr'^om 

that we shall always assume, any solution /i^po] to ([5]) has a density with respect to 
Lebesgue measure at any t > 0, even if po does not. 

Recall now that the optimal control problem facing each player, say X^, is to minimize 
cost (j2]). Now the crucial difference with the games without common noise starts to reveal 
itself. For games without noise, one expects to get a deterministic curve fit in the limit of 
large N, so that in the limit, each player should solve a usual optimization problem for a 
diffusion in R. Here the limit is stochastic, and thus even in the limit the optimization 
problem faced by each player is an optimization with respect to an infinite-dimensional, 
in fact measure-valued, process. 

In fact, for fixed N, if all players, apart from the first one, are using the same control 
Ucomit, X, fi), the optimal payoff for the first player is found from the HJB equation for 
the diffusion governed by ([T]), that is, the HJB equation (where we denote X^ by x), 


dV 

— {x,fi) +inf 

Ot U 


dV 

b{t,x,fit,u)— + J{t,x,fit,u) 


1/2 2 ^/ 

T 2 ^^ind T ^com) (^) 


V—V , , 9H 1/2 2 \/ sd'^V 

+ fit,u{t,Xj, fl))— + -{ai^d + 




dx'j 


^ ^ (^comi^X^CT, 


921 / 921 / 

com \Xj ) Y / ^ comix i^(Tcom{Xj)~ — 0. 

^ ^ l<i<j 


dXidXj 


( 11 ) 


As will be shown, in the limit when (J^,^ + • • • Sxj^)/N converge to the process fit, 
this equation turns to the limiting HJB equation 


dV 

^(x,^) + inf 


dV 

b{t, X, fi, u)— —h J{t, X, fi, u) 

U Jb 


1/2 2 N/ 

+ 2Yind + ^com)Y)~Q^ 


T ^limV ix, fi) -|- 


^ comix) (J comiy^ 
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dxdy 


SV[x, fi) 

5fiiy) 


fiidy) = 0, 


( 12 ) 
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where the operator Kum is calculated in (11041) with Ucom as the control. 
If J is convex, the infimum here is achieved on the single point 


h) QiTgTnClX^ 

fdJ\ 


dV 

h{t, X, lit, + J “) 


-1 


= -(^) {b2{t,X,lit)^) . 


\du J 


dx J 


( 13 ) 


Now the difference with the usual MFG is fully seen. Instead of a pair of coupled 
forward-backward equations we have now one single inhnite-dimensional equation flT^ . 
Namely, for any curve Ucomit, x, li) (defining Aum in fllU4p and thus in flT^ ). we should 
solve equation (1121) with a given terminal condition leading to the optimal control (1131) . 
The key MFG consistency requirement is now given by the equation 


'^ind{t, X, p) Ucom(t, X, /i). 


(14) 


This can be interpreted as having a limiting game of two players, a tagged player and 
a measure-valued player, for which we are looking for a symmetric Nash equilbrium. 

Equivalently, the MFG consistency o can be encoded into a single quasi-linear 
deterministic inhnite-dimensional partial differential second order backward equation on 
the function V{t, x, /i), which we present now in full substituting An^ from (I104p and (ITTp 
in (HH): 


dV, 

-^{t,xii) + 


dV 

b{t, x,ii,u)— + J {t, X, li, u) 




1,2 2 >, 2 ^“'^ 1 /■ ,2 , 2 PV{t,X,r) ,2 , ,2 2 


b{t, .,/i,M(t, .,li))\^(^t,z,tL)=-i^)-Hb2{t,z,tL)^) ^ 


SV{t,x,ii)\ f d‘^6V{x,ii) 

{y)li{dy) + / (Jcom{x)acom{y)Tr^ - ^ A{dy) = 0, 


6ii{.) 


dxdy 6ii{y) 


with a given terminal condition 

Vt{x,li)\t=T = VT{x,ii), iit\t=o=Ao- 

If 


J (f, X, p, u) = -U^, b 2 {t, X, /i) = 1, 


then (fl^ simplihes to 

dV 

dt 


{t,x,ii) + 


, , dV\ dV 1 fdV^ ^ 


, 2 , 2 , 1 /■ ^ ^ t ^ a) \ \ 


(15) 


(16) 
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SV{t, X, /i) 

SK-) 


{y)Kdy) 


ac„n{x)a^(;ll )- 0 . 


(17) 


The MFG methodology suggests that for large N the optimal behavior of players 
arises from the control u given by flT^ with V solving fflSj) . or equivalently, satisfying the 
consistency condition ffTT|) . 

To justify this claim one is confronted essentially with the 3 problems: 

MFGl): Prove well-posedness of (or at least the existence of the solution to) the 
problem flT^ or (flTD : 

MFG2): Analyze the Nash equilibria of the A^-player game given by ([T]), ([2]) and prove 
that these equilibria (or at least their subsequence) converge, as —)■ oo, to a solution of 
the problem flTHl) or flTTl) : assess the convergence rates; 

MFG3): Show that a solution to the problem flT^ or flTT)) provides a profile of sym¬ 
metric strategies Ut{x), which is an e-Nash equilibrium of the A^-player game given by 
0.0 and the initial distribution of players /xq, with e{N) —)■ 0 as —)■ cxo; estimate the 
error-term e{N). 

Questions MFG2), MFG3) are of course two facets of the same problem on how well 
the solutions to the limiting problem ffl5|). ffT^ . flT3|) .(fT6 |) ) approximate a finite player game, 
but the methods of dealing with these problems can be rather different. 

To link with the usual MFG, let us notice that for the case without common noise 
given by ([T]) with acom = 0, equation flTSl) . say, turns to 


dt 


(f,X,/i) + 


b 



dx ) dx 2 \dx ) 



d^V 

dx‘^ 


b{t,.,^, -Vl/(f,.,/r))V +-a2„rf(.)V^ 


6V{t,x,^i) \ 
5/i(.) J 


{y)y{dy) = 0, 


(18) 


giving a single-equation approach to usual MFG. In fact, solving this equation for a 
function V(t, x, y) is equivalent to solving first the deterministic (forward) equation ([2]) 
with acorn = 0 and then the backward equation 




{t,X,fJ,t) + 


dV\ 

f,x,pt,-— 

ox J 


^ 1 
dx ^ 2 



+ 2^ind^ 


X 


d^V 

dx'^ 


0 


for a function V(t,x). 

In a more abstract form the link between the forward-backward formulation and the 
single backward formulation is as follows. If {xt, yt) is a controlled Markov process (not 
necessarily measure-valued), optimal payoff is defined via the corresponding HJB on a 
function V{t,x,fi) of three arguments (corresponds to our general common noise case). 
If the evolution of the coordinate fit is deterministic and does not depend on x and its 
control, one can (alternatively and equivalently) first solve this deterministic equation 
on fi (usual forward part of the basic MFG) and then substitute it in the basic HJB 
to get the equation on V(t,x), the function of two arguments only, with fit included in 
the time dependence (usual backward part of the basic MFG). This decomposition into 
forward-backward system is not available in general. 
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In this paper we are going to concentrate exclusively on question MFG3), aiming 
at proving the error-estimate of order e{N) ~ 1/N. Our approach will be based on 
interpreting (by means of Ito’s formula) the common noise as a kind of binary interaction 
of agents (in addition to the usual mean-field interaction of the standard situation without 
common noise) and then reducing the problem to the sensitivity analysis for McKean- 
Vlasov SPDE. 

The question MFGl) can be approached via the methods of papers [27], [28], which 
will be addressed in another publication. Some existence can be also derived from [7|, 
which has however a slightly different formulation than the present one. 

Our paper is organized as follows. Next section provides a short literature review. 
Section [3] formulates our main results and indicates the strategy of their proof. Sections 
min] are devoted to the regularity and sensitivity analysis of the solutions to the McKean- 
Vlasov SPDEs and the related properties of the corresponding measure-valued Markov 
processes. The last three Sections prove the Theorems formulated in Section [S] 


2 Brief literature review 

Mean-field games present a quickly developing area of the game theory. It was initiated 
by Lasry-Lions [30] and Huang-Malhame-Gaines [TO], [20], [21], see [3], [1], [IT], [10], [0] 
for recent surveys, as well as i. in. la and references therein. 

New trends concern the theory of mean-held games with a major player, see [33], the 
numeric analysis, see [T], and the games with a discrete state space, see [15] and references 
therein. 

Even more recent development deals with mean-held games with common noise, which 
are only starting to be analyzed. Of course, common noise can be considered as a kind of 
neutral major player, but the usual setting for the latter [33] introduces the corresponding 
noise into the coefficients of the SDEs of the minor players, rather than adding additional 
common stochastic diherential. One of the ideas (and results) of our contribution is to 
use the method of stochastic characteristics to link these two models. 

Some simple concrete models of mean-held game types with common noise applied 
to modeling inter bank loans are analyzed in detail in [3]. A model of common noise 
with constant coefficients is discussed in [2]. Seemingly hrst serious contributions to the 
general theory of mean-held games with common noise are the preprints [7] and [29], which 
includes well-posedness for the mean-held limiting evolution under certain assumptions. 
However, [7] and [22] work mostly with controlled SDEs, and our approach is rather 
diherent, being based on McKean-Vlasov SPDEs. The references on the literature on 
McKean-Vlasov equation are given in the Sections devoted to this equations. 

3 Our strategy and results 

Our main result is the following. 

Theorem 3.1. Let h, acorns CFind satisfy the assumption of Theorem below and let 
V{t,x,fi) be a solution to problem flT^ . flTB]) . Assume J{t,x, fi,u{t,x, p,)) and V{t,x,p), 
as functions of {x, p) satisfy the assumptions on function F from Theorem \3.3[ below. 
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Then the profile of symmetric strategies given by ffT^ is an e-Nash eguilibrium of 

the N-player game given by o, 0. with e{N) ~ 1/N as N ^ oo. 

Remark 2. The assumptions can be weaken in many ways, but some regularity of the 
control synthesis u (like being Lipschitz in x, ja) is definitely needed for the rather subtle 
estimate 1/N. 


Additionally, in preparation to this result, we obtain two other results of independent 
interest, not linked with any optimization problem, namely the regularity and sensitivity 
for McKean-Vlasov SPDE, Theorems 14.21 and I5.1| and the 1/A^-rates of convergence for 
interacting diffusions to the limiting measure-valued diffusion. Theorem 13.21 (often inter¬ 
preted as the ’propagation of chaos’ property). Notice that the convergence itself is a 
known result (see e.g. [13] or [32]). The well-posedness of the McKean-Vlasov SPDE 
was shown in [32] in the class of L 2 -functions, and for measures in [13], though under an 
additional monotonicity assumption. 

Let us £x some basic notations for the function spaces. For a topological space X, 
C{X) denotes the Banach space of continuous functions equipped with the sup-norm 
||.||. The topology on measures will be always the weak one. If X = R'^, then C^{X) 
denotes the Banach space of functions with all derivatives up to order k belonging to 
C(X), LfiX) denotes the space of integrable functions, Loo{X) the space of bounded 
measurable functions with the essential supremum as a norm, H\{X) the Sobolev space 
of integrable functions such that its generalized derivative is also integrable. If X is not 
indicated explicitly in this notations we mean X = R. 

Let C'^^^(R^‘’*) denote the space of functions / on R^'’* such that the partial derivatives 


d^+hf 

7 -——r with multi-index a,B such that |a| < k, \B\ < k, 
ox'^dyP 


belong to C(R^'^). 

Remark 3. The space looks a bit exotic. However, it is very natural for the 

study of the second order derivatives of nonlinear measure-valued flows. The spaces of 
this kind also play an important role in the analysis of stochastic flows in H. Kunita 
fSTf . though Kunita’s spaces are slightly more general as they allow for a linear growth of 
functions. 


as 


Recall that for a functional F{fi) on A1®*^”(R‘^), the variational derivative is dehned 

'Ib] = :^|/i=oi^(h + h6x). 


(5/r(x) dh' 

Derivatives of higher order are dehned accordingly. For instance, if F = Fj is given by 
([3]), then 


5F 

6fi{x) 


= k Fj{x,X2,--- ,Xk)ia{dx2)---ia{dxk), 


6^F 


= k{k-l) / Fj{x,y,xs, - ■ ■ ,Xk)ia{dxs) ■ ■ ■ n{dxk). 


6iJ.{x)6iJ.{y) 

Let (Rfi)) denote the space of functionals such that the /cth order variational 

derivatives are well dehned and represent continuous functions. It is a Banach space with 
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the norm 


ll^ll 




k 

j=0 xi,--- 


5^F 

5/i(xi) • • • S^{xj) 


Let denote the subspace of C^(A^^*^”(R'^)) such that all derivatives up 

to order k have continuous bounded derivatives up to order I as functions of their spatial 
variables. It is a Banach space with the norm 


ll^ll 


k 

sup 

j=0 


6^F 






Finally, let be the space of functionals with the 


norm 




6^F 




Cfexfc{R2d) 


These Banach spaces are natural objects for studying sensitivity for nonlinear measure¬ 
valued evolutions. As we are interested mostly in probability measures, we shall usually 
tacitly assume A = 1 for these spaces. 

As the derivatives of measures are not always measures (say, the derivative of Sx is 
6'^), to study the derivatives of the nonlinear evolutions one needs the spaces dual to the 
spaces of smooth functions. Namely, for a generalized function (distribution) ^ on R*^ we 
say that it belongs to the space [C'^(R'^)]' if the norm 


ll^lllcHR'^)]' = sup I (^,0)1 


is finite. For instance, 

II4^^II[c'=(r'*)]' = 1- 

We shall use these norms mostly for generalized functions that are given by locally inte- 
grable functions. In this case the [C'(R'^)]'-norm coincides with the Li norm. To see why 
these spaces are handy, let us observe that if we take a spatial derivative of a heat kernel, 
then its Li-norm is of order for small t, but its [C"(R‘^)]'-norm is uniformly bounded. 

Let us explain our strategy for proving Theorem 13.11 

For any N and a hxed common strategy Ut{x, //), solutions to the system of SDEs ([T]) 
on f G [0, T] dehne a backward propagator (also referred in the literature as a flow or as a 
two-parameter semigroup) = U^^[u{.)], 0 < s < t < T, of linear contractions on the 
space C'sym(R^) of symmetric functions via the formula 

f)ixi, ■■■ ,xn) = E/(Xi, • • • , Xjv)s,t(a;i, • • • , xjv), (19) 

where (Xi, • • • , ‘is the solution to ([I]) at time t with the initial condition 


(Ai, • • • , Xn)sA^i^ ■■■ ,xn) = {xi, ■■■ ,xn) 

at time s. The corresponding dual forward propagator is dehned by the 

equation 




( 20 ) 

















It acts on the probability measures on R"^, so that if /x is the initial distribution of 
(Xi, • • • , Xtv) at time s, then is the distribution of (Xi, • ■ • , X^v) at time t. 

By the standard inclusion 

(xi, • • • , Xat) —)■ + -^ ^Xn) (21) 

the set R'^ is mapped to the set RAr(R) of normalized sums of N Dirac’s measures, so 
that can be considered as propagators in C'(RAr(R)) and V{VN{Ii.)) respectively. 

On the other hand, for a hxed function ut{x,fj,), the solution of SPDE (j5]) specihes 
a stochastic process, a diffusion, on the space of probability measures P(R) dehning the 
backward propagator U^’*' = U^’*[u{.)] on (^(^(R)); 

(t/^’V)(h) = E/(/x.,(/i)), (22) 


where is the solution to ([5]) at time t with a given initial condition /i at time s <t. 

From the convergence of the empirical measures /if^, mentioned above, it follows that 
t/^* tend as X —)■ oo. The following result provides the rates for the weak conver¬ 
gence. 

Theorem 3.2. Assume Uind-,o'com £ C'^(R) and are positive functions never approaching 
zero. Assume 

6(t, X,., M(t, X,.)) e n C^’^)(Xlf^”(R)), 

f)h 

bit, ., /X, uit, ., /x)) e C2(R), ^{t, X, ., xx(f, X,.)) e C^’0(Xir"(R)) 

with bounds uniform with respect to all variables. Then, for any /x 6 P 7 v(R) and F G 


for 0 < s < t < T. 


N 


(23) 


This result belongs to the statistical mechanics of interacting diffusions, so that its 
signihcance goes beyond any links with games or control theory. 

This result is not sufficient for us, as we have to allow one of the agent to be¬ 
have differently from the others. To tackle this case we shall considered the corre¬ 
sponding problem with a tagged agent. Namely, consider the Markov process on pairs 
(X/’^,/xf^)[xx*”'’*(.),?x“™'(.)], where X"'’* and are some D-valued functions xxj"''^(x,/x), 
^com(x,/^), ixl’^,--- solves ([T]) under the assumptions that the hrst agent uses 

the control , /if) and all other agents i use the control uf'^iXf^, and 

,,N _ 1 r 

Tt 

Remark 4. The coordinates {Xl'^,fif) of our pair process are not independent. Quite 
opposite, X]'^ is the position of the first 6-function in . However, we are aiming at the 
limit N ^ oo where the influence of X]'^ on pfl becomes negligible, and we do not want 
it to be lost in the limit. Alternatively, to avoid this dependence, one can consider (as 
some authors do), instead of our pf, the measures that do not take X/’^ into account, 
that is pfl = jq'Yld= 2 ^x^’’^’ would neither change the results, nor simplifies the 

notations. 
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Let us now define the corresponding tagged propagators 

iUZa,F)ix,f^) = EF(X^"^,pf)K'^(.),n“™(.)](^,h), (24) 

where p = ;^ position of the process at time s and where x = xi; 

«F)(a;,/r) = EF(X,\ p,)K'^(.), h), (25) 

where the process (X/, pi)[M*”'^(.), M'^'’"*(.)](a:, p) with the initial data at time s is the 
solution to the system of stochastic equations 

dXl = b{t, Xl Pi, vd^\Xl Pi)) + a,UXl)dBl + a,om{Xl)dWt, (26) 


d(0, lit) = (L[t, Pi,«“'"(., Pi)]0, fit) dt + (acom(-) fit) dWt 

(the second equation is actually independent of the hrst one). 

The following is the basic convergence result for the tagged processes. 


(27) 


Theorem 3.3. Under the assumptions of Theorem \3.2\ (with both satisfying 

these assumptions), let F{x, fi), a; G R, belongs to the space fl C^’^)(A4f^”(R)) as 

a function of fi, F G C^(R) as a function of x and ^{x, .) G C^’^(A4f^"'(R)). Then, for 
any ft G 'PAr(R) 




C{T) 

C(RxA^f«"(R)) ^ pj ■ 


(28) 


Theorem 13.21 is a particular case of Theorem 13.31 obtained from the latter by ignoring 
the hrst coordinate. However, by methodological reason, we hrst prove simpler Theorem 
13.21 and then its extension Theorem 13.31 

It is now seen how Theorem 13.11 should be deduced. Since the evolutions and 
U)f^ag close to each other, the corresponding optimal policies of the tagged agent 
should also be close. Details are given in Section [HI 


4 On the regularity of McKean-Vlasov SPDEs 

In this and the next sections we develop the sensitivity analysis for McKean-Vlasov 
SPDEs, which, on the one hand side, represent an important ingredient in the proof 
of our main result on mean-held games, but on the other hand, has an independent sig- 
nihcance for the theory of SPDEs. Notice that there is quite an extensive literature on 
the properties of equation fl29|) with A = 0 (see e. g. [JH], [11] and references therein), 
but for A = 0 much less is known, so that even the regularity results from Theorem 14.21 
below seem to be new. 

For a function v{t,x), t > 0,a; G R, let us consider the stochastic equation 

dv = Lt{v) dt + Qv o dWt, (29) 

where Wt is a one-dimensional Brownian motion, 

dv 

VLvix) = Atx )—— h Bix)v{x), (30) 

ox 
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(31) 


1 11 cil) 

Lt{v) = -a'^{x)— + h{t,x, [v])— + c{t,x, ['i;])v, 

with some functions A{x), B{x),(t{x) and the functions 6 , c depending in a smooth way 
on the function (or a measure) v. To visualize this dependence, one can think of b, c 
depending on v via a hnite set of moments of type 

Fj[v] = / Fj{xi,---,xk)v{xi)---v{xk)dxi---dxk, (32) 


with some bounded symmetric measurable functions Fj. 

In fl29|) . o denotes the Stratonovich differential. From the usual rule Y odX = Y dX + 
^dY dX, one can rewrite fl2^ as an equation with Ito’s differential of the similar kind: 


dv = Ltiy) dt + flv dWt + 


(33) 


or explicitly 


dv = Lt{v) dt + fin dWt + - 


,d^v 


dv 




dx 


dt. 


(34) 


Our objective is to study the well-posedness of equation fl29|) and more importantly 
its sensitivity with respect to initial conditions. 

Our main assumptions will be that 


0 < (Ti < a{x) < ( 72 , 0 < < A{x) < A 2 , (35) 

that a e C^(R),B e C^(R),A e C^(R) so that 


supmax(|cr'(x)|, |a"(x)|, \B{x)\, \B'{x)\, |S"(x)|, \A'{x)\,\A"{x)\,\A"'{x)\) < Si, (36) 


and 

max {\\b{t, ., [n])||ci(R), \\c{t, ., H)||c(R)) < &i, (37) 


sup sup max 



6b{t,y, [n]) 


dc{t,y, [n]) 


5 

db{t,y, [n]) 

1 

5n(.) 

Ci(R) 

(5n(.) 

1 

C(R) 

5n(. 

dy 



< C{\), 
(38) 


with some constants ai, ( 72 , Ai, A 2 , Si, 61 and a function C'(A). 

As above, we shall often omit the arguments of various functions. Moreover sometimes, 
we shall write v{t, x) as Vt{x) when stressing that certain operator acts on n as a function 
of X for a given t. 

Our basic approach will be the method of stochastic characteristics, see ED. I2S1. 
though in its simplest form, available for one-dimensional noise. This method allows one 
to turn equation fl 2 ^ into a non-stochastic equation of the second order, but with random 
coefficients. Namely, for A{x), B{x) G C'^(R), operator (l30|) generates a contraction group 
gto in C'(R), so that e^^Vo{x) is the unique solution to the equation 


dv 

dt 


= Qv 
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with the initial condition n(0,x) = no(x). Explicitly, 


e^^Vo{x) = Vo{Y{t, x))G{t, x), t G R, (39) 

where Y{t,x) is the unique solution to the ODE Y = —A{Y) with the initial condition 
Y (0, x) = X and 

G{t,x)=exp{ B{Y{s,x)) ds}. 

Jo 

In particular, G has the properties: 


--f 


G{—t,x) = G ^{t,Y{—t,x))=exp{ R(F(s, x)) ds} = exp{— / B{Y{s,x)) ds}, 


'-t 


1 dG d\nG Z'* w^Y, . , 

G & = i ^ 

Since the product-rule of calculus is valid for the Stratonovich differentials, making 
the change of unknown function v to g = exp{—r2hFt}x rewrites fl2^ in terms of g as 


gt ^ Lt\\V]{gt) ^ exp{-SiH^f}Lf(exp{Oiy(}(;f), 


(40) 


with i} denoting the usual derivative of a function v in time t. Of course one can obtain 
the same result using usual Ito’s formula and equation fl33l) . Since the operators form 
a bounded semigroup in Li(R), as well as in C'^(R) and 0^(R) whenever A,B E C'^(R), 
equations fl^Ol) and fl29l) are equivalent in the strongest possible sense. 

To have a more concrete version of fHOj) we calculate 


f) f)G f)n BY 

— {ex^{nW,}gt){x) = —{W,,x)g,{Y{Wt,x)) + G{Wt,x)^{Y{Wt,x)) — {Wt,x), 

o2 a ay 

— {exp{nWt}gt){x) = ^{Wt,x)gt{Y{W,,x)) + 2—{Wt,x)^{Y{Wt,x)) — {W,,x) 


dg. 


d^Y 


d^gt 


[BY 


+G{Wt,x)^{Y{Wt,x))^{Wt,x) + G{Wt,x)^{Y{Wt,x)) ( —{Wt,x) 


Bx'^ 


QY‘i 


\ Bx 


Hence, 


with 


Lt[W]{gt){x) = ^d2(x)^+ 6(f,x, [gt])^ + c{t,x, [gt])gu 

(BY \ ^ 

a‘^(x) = a^{Y{-Wt,x)) z)\,=Yi-Wt,x)] , 

f BY \ 

[g]) = {Kt,z, [exp{VtWt}g\)-^{Wt,z)\ \,=Y{-Wt,x) 


(41) 

(42) 


1 , (d'^Y ^ , B\nG , ,BY , 

-Y(z)[^0V.z) + 2—(W.,z)i^(W.,z) 


\z=Yi-Wt,x), 


(43) 


(9 In O' 

c{t,x, [g]) = ( c{t,z, [exp{nWt}g]) + b{t,z, [exp{QWt]g])^^{Wt, z) 


z=Y{-Wt,x) 
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z=Y(-Wt,x) 


(44) 


+ 



/ 1 d^G\ 

[g'^ ) 


m,z) 


The formulas above have straightforward extension to x from arbitrary dimension. 
The simplihcation arising from working in one-dimension is as follows: 


Y{t,x) = ^ (f-I-<h(a;)), 


where 


Hence, under 


$( 2 /) = 

it follows that 


'-y dz 


A{zy 


Hi dY A 2 


d^Y 


dx"^ 


{t,x) 


< 


B1A2 


1 

1 -I —- 

Al 


and 


d\nG 


dx 


(t,x] 


< m 


A 2 

Ai 


for all t,x and hence 


H-i _, , A2 

< a(x) < a,-, 


b{t,x, [^]) < C(T)(1 + Wt), c{t,x, [g]) < G{T)il + Wt), 

with some constants G(T) and Wt = maxie[o,T] |hhi|- 
Thus on any hnite interval of time [0,T] equation 


ji = Lt[W]gt 


(45) 

(46) 


(47) 


is the usual nonlinear McKean-Vlasov diffusion equation with uniformly elliptic second 
order part and bounded coefficients. For this equation both well-posedness and smooth 
dependence on initial condition is known, see e.g. [23] and [26]. A new point for us is the 
necessity to have bounds for the expectations of the various relevant objects. So we shall 
briefly recall the argument used for the analysis of the sensitivity of equation flT7|) paying 
attention to the latter issue. 

Let us first make a precise statement about equation fITTI) independently on its link 
with our initial SPDE. We shall need the following assumptions: 

di < d < 0-2, a' < 5-2, (48) 


max (^||6(f, ., [n])||ci(R), ||c(t,., H)||c(r)) < &(1 + Wt) 

and either 


(49) 


sup max 



5h{t,y, [n]) 


5c{t,y, [n]) 


5 dh{t,y,[v]) 


(5n(.) 

5 

C(R) 

(5n(.) 

5 

C(R) 

6v{.) dy 



< C{Wt, A) 
(50) 
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or 


sup max 



5b{t,y, [u]) 


bc{t,y, [u]) 


5 db{t,y,[v]) 


5u(.) 

ni(R) 

5u(.) 

ni(R) 

dv{.) dy 


Li{R) , 


|< C{Wt,X) 

(61) 

for some constants cri^ 2 , b and a function C depending on Wt = sup^gjQ \Wt\ and A. 

The idea is to rewrite the Cauchy problem for flT7|l with the initial condition in the 
mild form, that is as a hxed point equation 


for the mapping 


^9] = 9 


^9 ^ ^t[9]{x) = / G{t,x,y)go{y)dy 


+ / G{t-s,x,y) 


[ 9 s])-^{y) + c{s,y, [gs])9s{y) 


ds, 


where G{t, s, y) is the Green function for the Cauchy problem of the equation 

■ 1 - 2 / -.d‘^9 

Using integration by parts <h rewrites equivalently as 

‘l’<[9l(^)= / G{t,x,y)go{y)dy 


(52) 


(53) 


+ j ds 
Jo 


0 

G{t - s, X, y)c{s, y, [^,]) - x, y)b{s, y, [^,])) 


9s{y) dy, (54) 


from which it is seen that <h maps bounded families of functions gt, t G [0, T], with a given 
go, to itself, where ’bounded’ can be understood either in sup-norm or in Li-norm. 

The Green function G is random, i.e. it depends on W. However, by the standard 
theory of the second order equations (see [22j and H), assuming (HHD . the function G 
has the two-sided Gaussian bounds 

exp{-^77^1 < G{t,x,y) < —=exp{- 777 ^}, 


\/27rt ^ ^ 2tG3 

and the bound for the derivatives 


max 


dG{t,x,y) 


dx 


y/27rt 
dG{t,x,y) 


2tGA 


<G5 


d G 2 , {x-y)\ 
exp{-777^} 


< 


dy 

G 5 G 2 \x-y\ 


dx ' 2 tG 4 

with constants Gi — G 5 independent of the noise. 
This allows one to infer the estimates 


G4y/i y/t\/2'Kt 


exp{- 


{x - yf 
2tGA 




- ^t[ 92 \\\L^ < / ds 

Jo 


n - hi - 91 ]\\l^C{Wt, sup max(||^]||i,, ||c/f||ij) (55) 

yt — S SG[0,T] 
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in case of conditions fH 8 |) . (119|) . fl50|) or 

- / 91]\\c{K)C{Wt, sup niax(||^,^|lc(R), ||^,lc(R))) 

Jo yjt — s se[o,r] 

in case of conditions fHHj) . fH9|) . fl^ . 

From these estimates one can infer the convergence of the iterates in either sup- 

norm or Li-norm and hence the existence of the unique solution gt G Li for any initial 
5^0 G Li (and even for any initial hnite measure go) or of the unique solution gt G C'(R) 
for any initial go G C'(R) (and even for any initial bounded measurable go), whenever one 
can prove the uniform boundedness of the norms of all iterations. 

Let us see how one can get an estimate for the norm of the iterations. From the 
dehnition of <F and the estimates of the Green function G we get 

ii*rii < ciisoii+c f‘{t - s)-‘/"ii4r‘ii*. 

Jo 

where C = C{T){1 + Wt) with C{T) a non-random constant, and where ||*h”|| is the norm 
of the nth iteration of <F applied initially on go, and the norm is either in C'(R) or in Li. 
From this we deduce, by a straightforward induction, that 

ll^ril < C'll^oll(1 + CV^h/ 2 Ht) + • • • + (C'v^)’^-'J(„_i)/ 2 l(t) + C^-^7r^/^In/2Ht)), (57) 

were In/ 2 ^{t) is the application of the fractional integral of order n/2 to the constant 
function 1 (that equals one). And consequently we get for the limiting norm of the hxed 
point the bound in terms of a Mittag-Leffler function and hence eventually in terms of 
an exponent of Ct. Hence, since the expectation of exp{HV} is hnite, we can deduce the 
bound for the expectation of the hxed point yielding the following result. 

Theorem 4.1. (i) Under assumptions fl48ll . (j49]), fl50l) any T > 0 for any go G A1(R) 
there exists a unique solution gt of equation fl2^ on [0,T] such that gt G Li(R) for all 
t > 0, positive whenever go is positive, and 

Wgtht < Gi(r)exp{Gi(r)fTT}||( 7 o||^(R), E||^,|U, < C 2 {T)\\go\\Min) (58) 

with constants Gi_ 2 (T). 

Moreover, if Uo G Hi, then 

WgtWnl < C,{T)eMCi{T)WT}\\go\\HU < G 2 (T)||^o||r^ (59) 

Finally, for any go G A1(R), gt G Hi a.s. for allt > 0 and, if the bounds on the r.h.s. 
of (150|) do not depend on Wt, one has the estimate (uniform with respect to the noise) 

\\gt\\Hl < C3{T)-^\\go\\M(R)- (60) 

(a) Under assumptions dH]), fH9l) . flSTl) . for any go G Loo(R) there exists a unique 
solution gt of equation fl29l) on [0,T] such that gt G C'(R) for all t > 0, and 

IkJc(R) < C,{T)exp{C,{T)WT}\\go\\L^, E||r 74 c(R) < C 2 {T)\\go\\L^ (61) 
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with constants Ci^ 2 (T). 

Moreover, if go G C'^(R), then 

||5't||ci(R) < C'i(^) exp{Ci(T)iyT}||fi'o||ci(R)! E||5(t|lci(R) < C'2(T)||5 (o||ci(r)- (62) 

Finally, for any go G Loo(R), gt G C'^(R) a.s. for all t > 0 and, if the bounds on the 
r.h.s. of flSTj) do not depend on Wt, one has the estimate 

IktllcpR) < Co{T) — \\go\\c(R)- (63) 

Proof. Let us talk about (i) only, as (ii) is fully analogous. The proof of the hrst statement 
was already sketched above. The estimates for the norm in Hi are obtained from the 
iterations in a fully analogous way leading to Finally, we get from (IS2]) the estimate 

WgtWnl < ■^IIs'oIIli + J C{WT)-^y^==\\gs\\Hlds, 


so that 


sup (\/s||5fs||Ri) < lls'olUi + ViC{WT) 

sG{0,t] 


'0 y/t ~ S\/s <jG(o,t] 


sup {^/s\\gs\\m)ds, 


and thus 


sup (\/s||5'^||ri) < lls'olUi + \/iC{Wj 


du 


sS(0,t] 


lo \/l - u^/u se( 0 ,t] 


sup (\/i||^s||Rl)- 


If C{Wt) = C{T) actually does not depend on Wt we get for small enough t that 

sup (\/5||^,||j:^i) < - 

s€{0,t] 


with a constant C implying fl60l) . And in general we get a similar estimate a.s. 


□ 


Our basic objective is to study the sensitivity of the solution g^ with respect to initial 
data, that is 

ft{-;x)[go] = = ■^\h=ogt[go + h6^]. (64) 

This can be done in general by analyzing the convergence of the successive approximations 
to the solutions 

m[g]{y) 


^t{yw)[go] = 


Sgo{x) 


which satishes the recursion 


+ / ds 


^tiyw) = G{t,x,y) 
d 


G{t - s, X, y)c{s, y, ^) - ^iG{t - s, x, y)b{s, y, [^,])) 


“h / ds 


dgsiz) _ 


dy 

G{t- s,x,y)c{s,y, [^,]) 


C (d; x) dy 
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(65) 


dy 


{G{t-s,x,y)h{s,y, [^,])) 


C ^{z-,x)gs{y)dydz. 


Under the assumptions of Theorem 14. li say (i), we get the recursive estimates for in 
the form 


< C + C{T,Wt., sup ||(y'jLi) / (t 

te[o,T] Jo 




\j^sign 


(R)ds, 


and by linearity the same estimates for the increments in terms of 

the increments x) —^^~^{.;x) implying the convergence of the sequence and hence 
the existence of the derivative (l6T|) almost surely. 

To apply Theorem 14. ll to equation (12^ . we have to calculate the variational derivatives 
of the type 6F{exp{QWt}g)/Sg in terms of the derivatives of F. To this end, let us hrst 
hnd out, how the transformation acts on measures (rather than functions). For any 
functions n G Li, 0 G C'(R) we have 




(j){x)e^^v{x) dx 


G{t, x)4>{x)v{Y{t, x))dx 


= j G{t, Y{-t, z))4){Y{-t, dz, 

from which the extension to measures v is directly seen. Thus, for any measure g, we get 


5 


(0, 7 -^e g) = {(j),e 6^) = G{t,Y{-t,x))(j){Y{-t,x)) 
dg{x) 


dY (—f, x) 
dx 


so that 


Consequently, 


e^^g = G{t,Y{-t,x))^^\^^6Y(- 


6g{x 


dx 


6g{x 


-F{exp{nWt}g) = 


5F{y.) 


dfi^z) 


Y (—t,x) • 


(e*^’^''5i)(2) dz 


SF(tz) 


djjL^z) 


z=Y(-Wt,x) 


G{Wt,Y{-Wt,x)) 


fi=exp{UWt}g 

dY{-Wt,x) 


dx 


( 66 ) 


IJ.=exp{UWt}g 

Using this formula, equation - (HTll . and the convergence of sequence (|65|1 . we 
obtain the following result as a consequence of Theorem 14.11 


Theorem 4.2. Assume (jSS]) - fl38D hold and a T > 0 given. Then 

(i) For any vq G A^®*^”(R) there exists a unique solution Vt of equation fl29|) on [0,T] 
such that Vt G Ti(R) for all t > 0, positive whenever vp is positive, and 


Wvtht < Ci(T)exp{Ci(T)lUT}||no||^(R), E||n,|Ui < C'2(T)||no||A,(R) (67) 

with constants Gi^2 (T)- 
(a) If Vq G Hi, then 

llullr^i < Ci(r)exp{Ci(T)lUr}||no||^i, < C2 (T)||^o||rU (68) 
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(iii) For any vq G A^(R), Vt G a.s. for all t > 0 and, if the bounds on the r.h.s. 
of (150|) do not depend on Wt, one has the estimate 

< C'3(7')-^||fo||A^(R)- (69) 

(iv) The variational derivative ^i(.;a;)[vo] = of the solution Vt with respect to 

initial data exists a.s. as a measure of finite total variation. 

5 Sensitivity for McKean-Vlasov SPDEs 

We shall discuss in more detail the sensitivity of McKean-Vlasov SPDE fl29|) reducing our 
attention to a more specihc case of L having the form of a dual second order operator, 
namely to the equation 


dv = dt —'\/{A(x)v) o dWt, (70) 

where 

Lt,v(p=^(T\x)^ + b{t,x,[v])^, (71) 

and its dual, dehned as 

L't,vU = 2N)“(^))- ('^2) 

Equation (170]) is a particular case of flTO]) . so that the theory of the previous section 
applies. Moreover, this equation naturally rewrites in the weak form as 

d{(j), v) = v) dt + (n0, v) o dWt, (73) 

with Q(j) = A{x)V(j). 

Making in fl70|) the change of function to 5 ^ = exp{—fl'147}n, where fl' = —V o A{x) is 
the dual to fl, leads to the equation 

g = exp>{VL'Wt}g dt, (74) 

or in the weak form 

^(0, 9 ) = (^t,exp{n'Wt}g0, 9 ) = {exp{nWt}Lt,exp{n'Wt}g exp{-flWi}(?!), g). (75) 

Notice now that the operator = yl(a;)V coincides with (l30|) with vanishing B, and 
hence the corresponding transformation given by (|39|) has G = 1 and hence the 
estimates f|46l) does not contain Wt- Moreover, 

= (76) 

SO that the estimate fl46|l for the operator also does not contain Wt- Consequently 
Theorem 14.21 for equation fl70|) holds in its strongest form containing estimate fl69|) . More¬ 
over, general formulas flTT]) - fl44|) simplify essentially for R = 0 , c = 0 allowing us to rewrite 
L from fl75]l as 

~ 1 (f) ~ f)(b 
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where Y{t,x) solves the ODE Y = —A{Y) with the initial condition y(0,a;) = x and 


[g]) = 


BY 1 B'^Y 

b(t, z, |exp{fi'H/,}g])—(-H-'t, z) + -cr'^(z)-^(-tV,, z) 


(78) 


z=Y(Wt,x) 


Furthermore, as operator (1771) is the generator of a diffusion, its solution cannot in¬ 
crease the sup-norm, and hence the solution to equation (1701) does not increase the Li- 
norm (or, equivalently, the A^(R)-norm). 

To study sensitivity of equation dTOjl . we can now apply the results of [23] and [26| to 
equation ([75]). However, these results yield the existence of the derivatives with respect 
to initial data for almost all Wt-, and we are interested here in the expectation of all 
bounds. Therefore, we sketch briefly the approach of [2S| to see how the estimates for the 
expectation arise. 

Let us differentiate d77|) to get the equation for the derivatives 


the existence of these derivatives is already proved in Theorem 14.21 
Using flHTj) we get 


(0) ^ti^-1 [S'o]) (-hi,exp{r 2 'Wt} 30 ) [S'o]) 


5h{t, z, [exp{D'H7}5f]) BY {-Wt, z) 


6g{r) 


Bz 


^t{r;x)[go]^gt{y)dydr. (79) 

z=Y(Wt,y) 


Thus the evolution of considered as measures, is dual to the evolution on functions 
defined in the inverse time via the equation 


0s exp{f2'Wt}g0s 


5h{t,z,[e^v{^'Wt}g])BY{-Wt,z) 




Bz 


z=Y(Wt,y) 


By 


■9s{y) dy. 


(80) 


This equation dehnes the backward propagator f/^’0 s < t, on C^(R), such that is 

the solution to equation (1801) with the terminal condition (j) at time t, and = (U*’®)', 
where U*’* is the forward propagator yielding the solution to equation d79|) . To see that 
is well dehned as claimed, let us write (IHOl) more explicitly. Namely, as follows from 
(ITSD and dHU), 


F(exp{D'fU,}(7) = 


Consequently, 


6g{x 
rewrites as 


6y{z) 


(81) 


ti=exp{fl'Wt}g,z=Y {Wt,x) 


4^s{p') exp{f2'Vl7t}g0s(p) 


r 5b{t,z,g) 

r=Y(Wb,p) dY{-Wt,z) 

J dy{r) 

fi=e^p{n'Wt}gs 


z=Y(Wt,p) 


By 


■9s{y) dy. 


(82) 
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From the form of L it is seen that it generates a Feller semigronp in C'(R) with an 
invariant domain C'^(R), and the second term of (l9^ is a bonnded operator in C'^(R), 
due to the assumption (l38|) on the norm of 5h{t, y, [n])/5n(.) in C'^(R). Thus one can solve 
fl^ by the standard perturbation theory showing that 

\\Us,t(l>\\c^{R) < C(^)||0||ci(R) 

with C(T) depending only on the ||(y'o||Ar(R) and not on the noise implying that 

nUs,tcl>\\cHR)<C{T)\\cl>\\cHny 

Consequently the dual propagator C*’® dehning the solution to ^ in equation fl79|) is a 
bounded propagator in the dual space (C^(R))', both a.s. and on average. Similarly, 
assuming additional smoothness of coefficients we can claim that acts in C'^(R). 
Finally, by moving the derivative of 0 in the second term of fl92p to g via the integration 
by parts and using fl69|l allows one to show that f/®’* acts as a bounded semigroup in 
C(R). Therefore, the estimates 

\\Us,M\cHn) < C(T)||0||ckr), E||17,,,0|1c.(r) < C(T)||0||ckr) (83) 

hold for k = 0,1,2 with constants C{T) depending only on the ||no||A/((R). The dual 
propagator solving equation flTOjl . is a bounded propagator in the dual spaces (C(R))', 
(C^(R))' and (C'^(R))' with bounds independent of the noise. This implies that the dual 
propagator V^’^, solving equation (179]), is a bounded propagator in the dual spaces (C'(R))', 
(C'^(R))' and (C'^(R))' with bounds independent of the noise. Taking finally into account 
that 

(9 (9^ 

eo(.,x) = 5.eM(R), —eo(.,a;)=5' e(C'(R))', _eo(.,a;) e (^^(R))', 

leads us to the following result. 

Theorem 5.1. Let T > 0 and 


0 < (Ti < a{x) < (72, 0 < y4i < A[x) < A 2 , (84) 

that a G C^(R), A G C^(R) so that 

sup max (I a'(x) I, |(t"(x)|, |y4'(x)|, \A"{x)\^ |2l'"(x)|) < Bi. (85) 


Let 


IIK<.M)IIc>(r) < W, 


( 86 ) 


sup sup max 



5h(t,y, [x]) 


5 dh{t,y,[v]) 


(5x(.) 

C2{R) 

dv{.) dy 



< C(\), 


(87) 


with some constants ai, (T 2 , Ai, A 2 , Bi, bi and a function C(A). Then the following holds: 

(i) For any Xq ^ A1®*^”(R) there exists a unique solution Vt of equation fl29|) on [0,T] 
such that Vt G Ti(R) for all t > 0, positive whenever vq is positive, and with the norm 
not exceeding ||xo||a^(r) for all realization of the noise W. Moreover, Vt G Hi for allt > 0 
and the following estimates hold 


H 


<C'(T)|KIIri, 


E 


H 


<c'(T)IKII 


Hh 


( 88 ) 
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(89) 


< C(T)-^\\vo\\m{-r:), E||wi||^i < C(T)^||t>o||A^(R). 

(ii) The variational derivative ^i(.;a:)[fo] = svolx) solution Vt with respect to 

initial data are well defined as elements o/Li(R) for any x and t > 0, and their first and 
second derivatives with respect to x are hounded elements of the dual spaces (C^(R))' and 
(C^(R))' respectively, so that 

lleo(.,i^)llL, <C(r), ||^&(.,i)||(c.(R)y<C(r), ||_e„(.,i)||(c«,R„. <G(T) (90) 

with constants C(T) depending only on the norm ||fo||Ai(R) and independent of the noise. 

We are also interested in the second derivatives of the solutions Vt with respect to 
initial data: 

d 

r]t{,--,Xi,X2) = — U=o6(-;a:i)[no + h5fi\ = Ui=fe2=ohfK + + h25,,f\. (91) 

dh uh\uh2 

For this r] we get the following equation differentiating fl79p with respect Qq] 


(05 ^1) ^ 2 )) (-ht,exp{r2'Wt}g05 ht('5 ^l5 ^ 2 )) 

6b{t, z, [exp{Tl'Wt}g]) dY{-Wt, z 


6g{r) dz 

6b{t, z, [exp{ffWJ(/]) dY{-Wt, z) 


r]t{r-, xi, X2)-^gt{y)dydr 

z=Y{Wt,x) 


Sg{r) dz 

5%{t, z, [exp{flWt}( 7 ]) dY{-Wt, z) 


^giri)5g{r2) 


dz 


d(j) 

z=Y{Wt,x) 

d(j) 

z=Y(Wt,x)^y 


ft{r,y;xi,X2)dydr (92) 

^t{r2; X2)^tiri; xi)gt{y) dydridr2, 


where ft{r,y;xi, X2) = [^t{r;x2)^t{y;xi) + ^t{y;x2)^t{r;xi)]. 

The well-posedness of this equations and then the existence of the derivative fl9ip 
follows as above. However, we need also the existence and bounds for the derivatives of 
g with respect to Xi,X 2 . 


Theorem 5.2. Under assumption of Theorem \5 . 1\ let b G C'^’^^^(Alf®”(R)) as a function 
of V with all bounds uniform in other variables. Then for any uq ^ Wli(R) the derivative 
fIMP is well defined for all t > 0,x and the following bounds hold 


dpi Qfi 

\\^^yt{.]Xr,X2)\\[cHn)Y < C{T) (93) 

with a,/3 <1 and with some (random) constants C depending on the time horizon T, but 
not on the noise W. 


Proof. In the light of the properties of f from Theorem 15.11 it is straightforward to see, 
differentiating equation fl92p with respect to Xi and X 2 that the assumptions made on b 
is precisely the one needed to make all terms not containing g uniformly bounded (due 
to the product structure of f entering the equation for g), so that they can be written by 
the usual perturbation arguments. □ 
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6 On the domain of the Markov semigroups gener¬ 
ated by the McKean-Vlasov SPDEs 


Since equation (170]) its solutions defines a Markov process, in fact a measure-valued dif¬ 
fusion, the corresponding Markov propagator being given on the continuous functionals 
of measures in the usual way: 

U^’^F{v) = ^F{vt{v,[W])), (94) 

where Vt is the solution to d70|) for t > s with given n = at time s. 

We use the same letter U that was used for the propagators discussed in the proof 
if Theorem 15.11 which should not cause any confusion, as U is used in the sense of (IMl) 
everywhere, except in the intermediate discussion leading to Theorem 15.11 

The main conclusion we need from the sensitivity analysis developed above is the 
invariance of the set of smooth functionals under this propagator, that is the following 
fact: 


Theorem 6.1. Under assumption of Theorem \5.2\ the spaces of functionals 
and its intersection with are invariant under the action of the operators 

fl9T|) . so that 

\\U^''F\\cr^Mr-m<C{T)\\F\\ 

\\W’^F\\ 

C2.1x1(_A4»“9"(R)) < C{T) (^11-^11(72,lxl(_yv,^is"(R)) + 11-^11 
with a constant C (T). 

Proof. It follows from Theorem 15.11 and the formula 

6F{vt)^ 


(95) 

(96) 




6v{x) 


6v{x) 


'R 


6vt{z) 


dz, 


that 


11^^’ -^IIc1'2(x7®"(R)) - ® 

^ _ 

< E 


'R 


SFjvt) 

6vt{z) 


^tiz-,.)[v] dz 


SF{vt) 


5vt{.) 

C2(R) 


dx"^ 




C2(R) 

< C{T). 


It follows from Theorem 15.21 and the formula 

{6^W’\F)){v 


= E 


(C2(R))' 

S^F{vt) 


= E 


'R 


SFjvt) 

6vt{z) 


r]t{z;x,y)[vo]dz + E 


6v{x)6v{y) 6v{x)6v{y) 

f 6^F{vt) 
r 2 6vt{z)6vt{w 


^t{z; x) [no]6(w^; v) K] dzdw, 


that 


-^llc2axi(_M«*9"(R)) < E 


S^F{vt) 


< 


dxf dx^ 


r]ti-;xi,X2) 


Sv{.)6v{. 

\\F\U 


[C2(R)]' 


Cixi(R2) 
C1’2(X«9"(R)) 


+ 


do 


dx^ 




(C1(R))' 


5/3 


dyh 





6^F{vt) 

(Ci(R))' 

6vt{.)6vt{.) 


C2.1x1(_A4«'9"(R)) 


leading to 


□ 
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K2 


7 Proof of Theorem 


Let us return to our initial equation ([T]). By the standard assumption of the Lipschitz 
continuity of all coefficients, equation ([T]) is well-posed in and specihes a Feller diffusion 
and the corresponding backward and forward propagators Un, Vn given by (IT^ . ([20]). 
We are interested in the limit of this diffusion as N ^ oo. 

Applying Ito’s formula we obtain the generator of the diffusion specihed by ([T]): 


N 


■^N f ' ' ' ) ^7v) ^ ^ ^ com{Xi)(^comjxj) 

j=l i<j 




dxidxj ’ 


where fi = (5a;i + • • • + 5xj^)/N and 

Qq 1 

B^g{x) = b{t, X, fi, u{t, X, fi))-^ + -{aj^ix) + 


dx'^ ’ 


(97) 


(98) 


with denoting the action of on the Ah coordinate of /. 

Here and everywhere by a time-dependent generator, say Aat above, of a non-homogeneous 
Markov process we mean a time-dependent family of operators such that for / from some 
invariant dense subspace of bounded continuous functions the equation 


holds for s < t. In the case of the Wparticle diffusion, the invariant subspace can be 
usually taken to be the space of twice differentiable functions (which are invariant if a and 
b are twice and once differentiable respectively). In the case of the limiting measure-valued 
process the invariant domains will be given by the subspaces 

The hrst term in fl^7|l can be considered as describing a diffusion arising from the sys¬ 
tem of particles with a mean-held interaction and the second term as giving an additional 
binary interaction (though not of a standard potential type that can be easily included 
in the mean-held interaction). 

By the standard inclusion (ET]) . the process specihed by (1^ can be equivalently con¬ 
sidered as a measure-valued process dehned on the set of linear combinations ^^ 7 ( 1 ^-) of 
the Dirac atomic measures. On the level of propagators this correspondence arises from 
the identihcation of symmetric functions / on with the functionals F = Ff on Vn(R-) 
via the equation 

f{xi, ■■■ ,xn) = H-h S^j,)/N]. 

To recalculate the generator fl97|) in terms of functionals F on measures we use the fol¬ 
lowing simple formulas for diherentiation of functionals on measures (proofs can be found 
e.g. in |23]): for fi = with h = 1/N 


dXj dXj6fi{Xj)^ 

^F(n) = F 

dx'^j dx'j Sfi{xj) dydz 6fi{y)6fi{z) 

= _7 

dxidxj dxidxj 5fi{xi)5fi{xj) ’ 


5 

y=Z=Xj 


^j- 


(99) 

( 100 ) 

( 101 ) 
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Applying these formulas in conjunction with the obvious identity 




E 




(t){Xi,Xj) = - 



h f 

(l){zi,Z 2 )fi{dzi)fi{dz 2 ) - - / (j){z,z)fi{dz), ( 102 ) 


leads to the following expression of Aat in terms of F{fi) (for details and more general 
calculations see [23]): 

AnF{^) = A/i^F(/i) + ^Acorr^(h), (103) 


N 


with 


AlimF(^fi) 


in 




1 

2 


CTr 


'R2 






6^F 


Acorr F{y) = 2 


a. 


indi^) 


dydz 6fi{y)6^{z 

6^F{y) 


'R 


dydz 6y{y)6y{z) 


-y{dy)y{dz), 

I 

y{dx). 


(104) 


(105) 


y=z=x 


Thus we have an explicit expression for the limit of A^v as iV —)• cx) and for the 
correction term, which are well dehned for functional F from the spaces fl 

( 72 ,lxl(^sj 3 n)_ 

It is straightforward to check by Ito’s formula that the operator Aum generates the 
measure-valued process dehned by the solution of equation ([T|). Hence we have the conver¬ 
gence of the generators of iV-particle approximations to the generator of the process given 
by ([I]) on the space fl with the uniform rate of convergence of 

order 1/N. 

But according to Theorem 16.11 the propagator of the process generated by ([I|) acts 
by bounded operators on this subspace. Hence Theorem 13.21 follows from the standard 
representation of the difference of two propagators in terms of the difference of their 
generators: 

(*r 

(106) 


- H*’®- = / - Au^)sU^'^ds. 


Tt,S 
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Proof of Theorem 


S3 


The well-posedness of the process on pairs {x, y) solving equations fl26l) and is 
straightforward once the well-poesdness of the process solving fl271) is proved, because 
equation fl27|) does not depend on x, and once it is solved, equation fl26|l is just a usual 
Ito’s equation. Straightforward extension of the above calculations for the generator of 
the process solving (l27jl show that the process solving (j26jl - ^Tj\\ is generated by the 
operator 

AlimF{x^ /i) -|- Aiji^F{x^ /i), 

where Aum is given by (11041) and acts on the variable p, 

dF 1 d^F 

AumF{x,y) = h{t,x,y,uT'^{x,y))— + ^ + A^om) (a^) ^ 
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comity')' 


5F 


F{dy), 


(107) 


dxdy 6y,{y) 

and with the same correction term fllOSp . Thus the proof of Theorem 13.31 is the same as 
for Theorem 13.21 
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Proof of Theorem 


ST 


Let Ml be any adaptive control of the hrst player and Vi the corresponding payoff in the 
game of N players, where all other players are using Ucomit, x, y) arising from a solution to 
ffT^ . flTOl) . Then Vi > V 2 , where V 2 is obtained by playing optimally, that is using control 
U 2 arising from the solution to flTTl) . By Theorem 13.31 

17^2 - V2,Um\ < C/N, 

where V 2 ^iim is obtained by playing U 2 in the limiting game specihed by equations fl26l) . 
fl27)l . But V 2 ^iim > V, where V is the optimal payoff for the hrst player in the limiting 
game of two players, where the second, measure-valued, player uses Wcom- Consequently, 

Cl > C 2 > V2,Um - § > C - 

completing the proof. 
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